We propose an integrative method of recognizing gestures such as pointing, accompanying speech. Speech\ngenerated simultaneously with gestures can assist in the recognition of gestures, and since this occurs in a\ncomplementary manner, gestures can also assist in the recognition of speech. Our integrative recognition method\nuses a probability distribution which expresses the distribution of the time interval between the starting times of\ngestures and of the corresponding utterances. We evaluate the rate of improvement of the proposed integrative\nrecognition method with a task involving the solution of a geometry problem.
Loading....